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PREFACE 



This report is an attempt to combine the report to teachers and the 
technical details in one volume. To make the report to teachers In Part 1 
more readable, only the essential procedure and findings are reported. 
Detailed discussion of the technical aspects and supporting data are given 
in Part 2. Appendix A, written by Dr. Maurice Tatsuoka, presents a full 
explanation of the hlerarchal analysis of variance, the technique used in 
the present study. The profiles in Appendix B are designed to give the 
readers an Idea of the average achievement of various treatment groups at 
a glance. 

The study reported here is a cooperative research venture by the ERC 
(Educational Research Council of America) and Its member school districts. 
Two major topics were investigated in this study: (1) comparison of the 
longitudinal effects of l.t.a. (initial teaching alphabet) and T.O. (traditional 
orthography) beginning reading programs through the end of grade three; 

(2) feasibility of starting l.t.a. instruction in kindergarten. 

The study was undertaken In the school year 1965-66 through 1967-68. 
Originally, 21 school districts participated in the study. Because of 
conflicts with the local testing programs of some school districts, change 
in the membership of ERC school districts, etc. only the nine school 
districts listed on page ii remained throughout the whole study. When 
the study was launched, all nine school districts had implemented l.t.a. 
for two years . 

The completion of the study required much cooperation and support 
of the nine contributing school districts. Acknowledgment is due to the 
superintendents, l.t.a. coordinators, principals, first, second, and third 
grade teachers, and other personnel of these schools. 

Dr. John B. Carroll and Dr. J. Thomas Hastings were advisers to 
this study. Dr. Maurice Tatsuoka advised in the planning of the statistical 
analysis. Dr. Doyle Bishop wrote the computer program and did the 
actual computation at the University of Illinois. 

Special credit should be given to Dr. i Thomas Bibler who supervised 
the production, to Mrs. Susan Detlenne who did much to assist in editing, 
and to the secretarial staff of the Evaluation and Testing Department, ERC, 
who typed and proofread the report. The Art Department staff of ERC was 
responsible for the art work. 
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April, 1970 



Wai-Ching Ho 

Educational Research Council of America 
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REPORT TO TEACHERS 



The importance of success in beginning reading has long been recognized 
by educators. However, the best method of teaching beginning reading 
continues to be a controversial subject. To help beginners overcome the 
stumbling block caused by the inconsistency in symbol-sound relationships 
in the English language. Sir James Pitman of England devised tho Initial 
Teaching Alphabet (l.t.a.). It consists of 44 characters designed to make 
the written symbols and the sounds of our language correspond more 
consistently. Further simplification is achieved through the elimination of 
capitals. After the pupils gain some fluency in reading l.t.a.. transition is 
made to Traditional Orthography (T.O.), the conventional alphabet and 
spelling. 

With the cooperation of the Council schools, the Evaluation and Testing 
Department of ERC conducted a longitudinal study to investigate the effects 
of l.t.a. on the pupils' reading achievement and the feasibility of starting 
l.t.a. in kindergarten. This study was designed to follow the same pupils 
through the end of grade three. 

The study Included approximately 700 pupils from nine Council school 
districts. About one-third of the pupils started T.O. in grade one. another 
third started l.t.a. <n grade one. and the remaining third started l.t.a. in 
kindergarten. The T.O. group used various basal readers, predominantly 
the Ginn and the Scott, Foresman series, supplemented by other readers such 
as those published by Lipplncott. The l.t.a. groups used the Downing and/or 
the Early To Read series for the Initial l.t.a. instruction and generally 
transferred to T.O. basal readers during the second semester in grade two. 

The T.O. readers most often used by the l.t.a. groups Included the Ginn; 

Scott, Toresman; and Lipplncott series, or some combination of these. 

Reading achievement of the pupils in this study was measured by the 
reading subtests in the Stanford Achievement Test: Word Reading, Paragraph 
Meaning, Vocabulary, Spelling, and Word Study Skills for grade one: Word 
Meaning, Paragraph Meaning, Spelling, Word Study Skills, and Language 
for grades two and three. In the fifth month of grade one, the l.t.a. pupils 
took the subtests in l.t.a. At the end of grades one, two, and three, all 
pupils were tested in T.O. 

The three groups were compared on each subtest by eblllty level. 

Ability levels were determined by the Lorge -Thorndike Intelligence Tests 
given in grade one. The average IQ was 95 for the low group (ranging from 64 
to 103); 108 for the middle group (ranging from 104 to 114); and 121 for the 
high group (ranging from 115 to 139). Significance of the differences among 
the three groups was tested by a statistical technique called the nested factor 
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design {a two-way hlerarchal analysis of variance). This method was 
employed In order to Isolate the unique factors that were associated with 
each classroom. A more detailed description of the technique Is found 
In Appendix A. 

The following are some highlights of the results of this 

study: 

• In the fifth month of grade one. when the l.t.a. pupils were tested 
in l.t.a., they demonstrated superiority to the T.O. pupils In 
Word Reading, Paragraph Meaning, Spelling, and Word Study Skills 
at all ability levels. 

• At the end of grade one, when the subtests were given in T.O., no 
significant differences were found between the T.O. and l.t.a. 
pupils In Word Reading, Paragraph Meaning, Vocabulary, and 
Word Study Skills at ali. ability levels, even though over 90% of the 
l.t.a. pupils had not made the formal transition to T.O. 

• At the end of grades two and three, no significant differences were 
found between the l.t.a. pupils and T.O. pupils on Word Meaning, 
Paragraph Meaning, Word Study Skills, and Language at all ability 
levels . 

• Despite no statistical significance between the l.t.a. pupils and 
the T.O. pupils in most subtests beyond grade one, the group that 
started l.t.a. in kindergarten performed better on almost all the 
subtests throughout the three years at all ability levels. 

• The T.O. reading series used by the l.t.a. pupils In the post- 
transition period seems crucial to their success In T.O. reading. 

Those l.t.a. pupils who used a reading series that emphasised 
the "phonics approach" (either exclusively or combined with a 
reading series that emphasised the "meaning approach") tended to 
be superior to their counterparts who used readers which emphasised 
the "meaning approach." Most pupils of the low ability level who 
were instructed under a "phonics approach" achieved at or above 
their grade placement on all subtests at the end of grades two and 
three. 

• Spelling did not seem to cause particular difficulty for l.t.a. pupils 
of a|i ability levels after they transferred to T.O. Although at the 

end of grade two middle ability T.O. pupils scored significantly higher 
on the Spelling subtest than their l.t.a. counterparts, by the end of 
grade three, l.t.a. pupils of gli ability levels were able to spell as 
well as the T.O. pupils. 
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In spite of the different research designs, different pupils, different 
teachers, and different reading programs involved in the various i.t.a. studies, 
the pattern of research results, Including those in this study, remains 
consistent. When tested in i.t.a. during grade one, the i.t.a. pupils 
demonstrated significant superiority over the T.O. pupils in skills which 
require sound-letter association, such as Word Reading and Word Study Skills. 
In the post-transition period in grades two and three, few significant 
differences were found between i.t.a. pupils and T.O. pupils on spelling 
and other reading subtests. The concern of some educatorj that 1. a. might 
have long-lasting and detrimental effects on pupils' T.O. spelling and reading 
has not been substantiated by research. 

This study further suggests that the type of program used in the post- 
transition period is a key factor to success in T.O. reading, particularly 
for the low ability pupils. In most cases, the scores of low ability i.t.a. 
pupils who used T.O. programs emphasizing phonics averaged at or above 
grade placement. This suggests that a phonics-emphasized program probably 
should be used in order to capitalize on the early advantages achieved 
through the use of i.t.a. Further study of this topic is needed. 

The study also suggests that the introduction of i.t.a. in kindergarten 
is not only feasible, but necessary if pupils a^e to show boneflts beyond 
grade one. The group of pupils who started i.t.a. instruction in kindergarten 
maintained their advantage through the end of grade three. Since no T.O. 
classes introducing reading instruction in kindergarten were available to this 
study, it is not possible to compare the merits of starting T.O. or i.t.a. 
in kindergarten. 

The use of i.t.a. has beon questioned by some educators because of the 
lack of statistical differences in reading achievement between i.t.a. and T.O. 
pupils beyond grade one in most studies. If it is assumed that we want 
children to havu the best possible success at every level of school learning, 
i.t.a. certainly has its merits in enhancing the beginning reader's word 
attacking skills. Furthermore, since i.t.a. spelling is regular, the child 
is likely to be able to read the i.t.a. books with relatively little help from 
the teacher once he learns to decode. This means that the i.t.a. books need 
not be as limited in vocabulary, scope, and content as the T.O. books for the 
beginning readers. Thus, the child could be helped to develop an enthusiasm 
for reading and for learning with a wide range of interesting and educationally 
valuable materials. Attention, however, should be given to utilizing the 
i.t.a. pupils' superior word study skills to develop vocabulary and 
comprehension. 
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TECHNICAL REPORT 



The importance of success in beginning reading has long been recognized 
by those interested in education. The best way to achieve this success 
remains controversial. The initial teaching alphabet, i.t.a., was designed 
with the purpose of simplifying the learning task for the beginners. Forty-four 
characters are used to increase the consistency between written symbols and 
sounds in the English language. Further simplification is realized through 
elimination of the capitals. 

The effects of i.t.a. on reading achievement have been the subject 
of investigation in many studies. Indeed, few educational innovations car. 
claim as much research. Six major studies have been reported since its 
introduction to American education in 1963 (Tanyzer & Alpert, 1966; 

Chasnoff, 1967, 1968; Fry, 1966, 1967a, 1969; Hayes, 1966; Hayes & Wuest, 
1967, 1969; Hahn, 1966, 1967; Mazurkiewicz, 1966, 1967). The pupils 
instructed in i.t.a. were usually compared with those taught with various 
reading programs in T.O., the traditional orthography. In spite of the use 
of different pupils, different teachers, different reading programs, and 
different research designs which have often been criticized (Asher, 1968; 

Block, 1966; Fry, 1967b; Gillooly, 1967, 1968), the trend of the findings 
is highly consistent and predictable. When tested in their own instructional * 
medium in grade one, the i.t.a. pupils performed as well as the T.O. pupils 
in vocabulary and reading comprehension, but excelled significantly their 
T.O. counterparts in tests which require symbol-sound association, such 
as word reading and word study skills. When tested in T.O. at or beyond 
the end of grade one, seldom were any significant differences found between 
the T.O. and i.t.a. pupils on the standardized tests. 

The study reported here was an attempt to provide answers to some 
questions not yet explored in earlier studies. Two major purposes were 
embodied in this study: investigation of (a) longitudinal effects of i.t.a. 
on reading achievement of pupils of various ability levels; (b) feasibility 
of starting i.t.a. instruction in kindergarten. 



Procedure 



Subjects 

Seven hundred fifteen pupils from nine Council school districts 
participated in the study. The same pupils were followed through the end 
of grade three. Of this sample, 281 pupils started T.O. in grade one, 

213 pupils started i.t.a. in grade one, and 221 pupils started i.t.a. in 
kindergarten. The three groups will be designated the T.O. group, the 
i.t.a. -grade one (or i.t.a. -1) group, and the i .t. a. -kindergarten (or i.t.a.-k) 
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group respectively. In all the school districts, i.t.a. was implemented 
two years before this study began. 

Instructional Materials 



All i.t.a. pupils used the Early To Read series, supplemented by 
the Downing i.t.a. program in some cases. They generally transferred 
to T.O. during the second semester in grade two. The T.O. readers 
used in the post-i.t.a. period were mainly the Ginn; Scott, Foresman; 
and Llpplncott series Most i.t.a. pupils were kept intact in the same 
classrooms in the firsi: two grades. The T.O. pupils used a great variety 
of basal reading serie j including those published by: Scott, Foresman; 

Ginn; Harper-Row; Row-Peterson; Houghton Mifflin; American Book Company; 
Llpplncott; etc. 

Variables 



The Lorge-Thorndike Intelligence Tests, Level 1, Form B, were 
given in the third month of the first grade. The reading achievement of 
the pupils was measured by the subtests in tho Stanford Achievement 
Test: Word Reading, Paragraph Meaning, Vocabulary, Spelling, and Word 
Study Skills for grade one; Word Meaning, Paragraph Meaning, Spelling, 
Word Study Skills, and Language for grades two and three. In the fifth 
month of grade one, the i.t.a. pupils took the tests in i.t.a., while the 
T.O. pupils took the corresponding tests in T.O. At the end of grades 
one, two, and three, all pupils were tested in T.O. 

At the end of grade three, teachers were asked to rate each pupil 
on four five-point scales: overall school adjustment, ability to apply 
oneself to learning, attitude toward reading, and emotional adjustment. 



Analysis 

The pupils were classified into three ability levels on the basis 
of the Lorge-Thorndike IQ's. Each ability level included approximately 
one-third of the 715 pupils. The mean IQ was 95 for the low level; 

108 for the middle level; and 121 for the high level. Within each ability 
level, the pupils were further subdivided by treatment. The number of 
pupils, mean IQ, and IQ range for each subgroup are given in Table 1. 

These data show that pupils of different treatments within each ability level 
were comparable with respect to IQ. 




Table 1 
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Number of pupils, mean IQ, and IQ range 
within each treatment group by ability level 



Ability 

level 


TVeatment 


Number 
of pupils 


Mean IQ by 
treatment 


IQ range by 
ability level 


Mean IQ by 
ability level 




i.t.a.-l 


40 


120 






High 


T.O. 


99 


122 


115-139 


121 




i. t.a .-k 


90 


122 








i.t.a.- 1 


75 


108 






Middle 


T.O. 


90 


108 


104-114 


108 




i.t.a. — k 


77 


108 








i.t.a.-l 


98 


94 






Low 


T.O. 


92 


95 


64-103 


95 




i . t . a . -k 


54 


94 







The Hierarchal Analysis 1 and the Newman-Keuls Test 

In order to account for the unique effects associated with each classroom, 
the hierarchal analysis was used to test the differences among the treatment 
groups for each dependent variable^ at each ability level. A significant 
F value may thus be explained as due to the treatment rather than to the 
combination of treatment and classroom effects. This analysis involved the 
nesting of classrooms within each treatment. To accomplish the nesting at 
grades two and three, the class was arbitrarily assigned to the treatment 
whose pupils were in the majority; pupils belonging to other treatments were 
deleted. The one-pupil classes which resulted from ability grouping and 
nesting were also dropped, since computation of the within class variance was 
impossible. As a result, the analysis involved different numbers of pupils 
from grade to grade. The actual numbers of pupils included in the analysis 



Dr. Maurice Tatsuoka of the University of Illinois made the adjustments 
in the general model for unequal numbers of students within each 
classroom and unequal numbers of teachers nested under each treatment 
(see Appendix A) . 

2 

The grade one T.O. Spelling test given at 1 .9 grade placement was not 
included in the comparison. Since most i.t.a. pupils were not able to 
spell in T.O. at the end of grade one, it is felt that the comparison was 
meaningless. 
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3 

end the IQ means are shown in Table 2. The deletions (from the original 
715 pupils) caused little change in the IQ's of the groups from year to 
year. 



When the F value of the hierarchal analysis was significant, 
the Newman-Keuls test was used to compare each pair of the treatment 
means . 



Table 2 

Size and mean IQ's of samples on which analysis was done 



Ability 


Treatment 


Grade 1 


Grade 2 


G 


rade 3 


level 


N 


Mean IQ 


N 


Mean IQ 


N 


Mean IQ 




i.t.a.-l 


35 


120 


32 


120 


27 


1 <9 


High 


T.O. 


97 


122 


89 


122 


82 


122 




i.t.a.-k 


89 


122 


86 


122 


88 


122 




l.t.a.-l 


72 


108 


65 


108 


56 


108 


Middle 


T.O. 


88 


108 


79 


108 


72 


108 




i . t . a . "k 


76 


108 


77 


108 


76 


108 




i.t.a.-l 


89 


94 


79 


94 


68 


94 


Low 


T.O. 


88 


95 


85 


96 


67 


96 




i.t.a.-k 


50 


94 


50 


94 


49 


94 



Analysis of the Use of the T.O. Programs in the Post-i.t.a. Period 

This analysis is of a descriptive nature. In order to detect the possible 
pattern that might exist among classes that used different types of T.O. 
programs in the post-i.t.a. period, the T.O. program used by each class 
was identified and classified under the "meaning emphasized" and "phonics 
emphasized" categories according to Chall's guidelines (1967). The 



3 

It should be noted that the number of pupils for grade ore in this 
table is not the same as that in Table 1. This is because pupils who 
did not have complete data in grades two and three were not included 
3 in the analysis . 
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"meaning emphasized" category included the conventional basal readers 
such as the Ginn and Scott, Foresman series. The "phonics emphasized" 
program(s) referred to the Lippincott series, either used exclusively or 
supplemented by other T.O. series. Programs whose classification was 
not clear were classified under the category "others." The mean scores 
of the classes under each category on the reading tests were plotted by 
ability level for grades two and three. 



Results 

The results of the hierarchal analysis are presented in Tables 3-5 
which correspond to the high, middle, and low ability samples respectively. 
These tables give the means of each treatment group on each dependent 
variable, the F values of the tests of the differences among treatments, 
and the F values of the tests of differences among classrooms. Results 
of the Newman-Keuls tests are given in Table 6. Mean scores of classes using 
various T.O. programs in grades two and three are plotted in Figures 1-6. 

The major findings of the study can be summarized as follows: 

1 . In the fifth month of grade one, when the treatment groups were 

tested in their own instructional medium, the i. t. a . -kindergarten 
group demonstrated significant superiority to the T.O. group in 
Word Reading, Paragraph Meaning, Spelling, and Word Study Skills 
at all three ability levels. The i.t.a.-grade one group scored 
significantly higher than the T.O. group on the following tests: 

Word Reading, Paragraph Meaning, Spelling, and Word Study Skills 
at the high ability level; Word Reading, Spelling, and Word Study 
Skills at the middle ability level; Word Reading and Word Study 
Skills at the low ability level. 

2 . At the end of grade one, when the subtests on Word Reading, 

Paragraph Meaning, Vocabulary, and Word Study Skills were given 
in T.O., no significant differences were found between the i.t.a. 
groups and the T.O. group at all ability levels. Most of the 
i.t.a. pupils had not made the formal transition to T.O. at that time. 

3 . Beyond grade one, no significant differences were found between 

the i.t.a.-l group and the T.O. group on Word Meaning, Paragraph 
Meaning, Word Study Skills, and Language at all ability levels. 

On the Spelling subtest, middle ability T.O. pupils scored 
significantly higher than their i.t.a.-l counterparts at the end of 
grade two. No significant spelling differences were found between 
the i.t.a.-l and T.O. high and low ability groups at the end of 
grade two or between the i.t.a.-l and T.O. pupils of any ability 
group at the end of grade three. 



O 




Table 3 
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Mean scores, teacher ratings, and the results 
of hlerarchal analyses of variance 
(High ability pupils) 



Dependent variable 


Treatment means 


Treatment effect 


Classroom effect 




i.t.a.-l 


T.O. 


i • t»d i “k 


df 


F 


df 


F 


SAT, Word Reading (1 . 5) a 


2.46 b 


1.77 


2.82 


2, 40 


32.45** 


36, 182 


3.11** 


SAT, Paragraph Meaning(1.5) 


2.04 


1.74 


2.29 


2,40 


6.87** 


36, 182 


3.21** 


SAT, Vocabulary (1.5) 


2.53 


2.67 


2.90 


2, 42 


1.17 


36, 182 


2.06** 


SAT, Spelling (1.5) 


2.39 


1.81 


2.56 


2, 41 


28.07** 


36, 182 


2.41** 


SAT, Word Study Skills (1.5) 


3.90 


2.20 


4.00 


2, 43 


36.91** 


36, 182 


1.96** 


SAT, Word Reading (1.9) 


2.44 


2.31 


2.53 


2, 41 


1.36 


36, 182 


2.57** 


SAT, Paragraph Meaning(1.9) 


2.55 


2.25 


2.45 


2, 41 


1.35 


36, 182 


2.52** 


SAT, Vocabulary (1 .9) 


3.06 


2.96 


3.15 


2,42 


0.53 


36, 182 


2.10** 


SAT, Word Study Skills (1.9) 


3.40 


2.78 


3.19 


2,43 


2.72 


36, 182 


1.84** 


SAT, Word Meaning (2 . 8) 


3.67 


3.65 


3.97 


2,43 


1.27 


37, 167 


2.41** 


SAT, Paragraph Meaning(2.8) 


3.61 


3.79 


4.25 


2,44 


3.15 


37, 167 


2.09** 


SAT, Spelling (2.8) 


3.36 


3.53 


3.67 


2,44 


0.56 


37, 167 


2.19** 


SAT, Word Study Skills (2.8) 


4.69 


4.37 


5.36 


2, 46 


4.92* 


37, 167 


1.78** 


SAT, Language (2.8) 


4.03 


3.80 


4.03 


2,42 


0.40 


37, 167 


3.09** 


SAT, Word Meaning (3.9) 


4.63 


4.86 


5.24 


2, 51 


1.78 


42, 152 


2.37** 


SAT, Paragraph Meaning(3.9) 


4.44 


4.79 


5.12 


2, 52 


2.07 


42, 152 


2.15** 


SAT, Spelling (3.9) 


4.20 


4.52 


4.54 


2, 54 


0.57 


42, 152 


1 .97** 


SAT, Word Study Skills (3.9) 


5.14 


5.13 


6.17 


2, 55 


6.84** 


42, 152 


1.52** 


SAT, Language (3.9) 


5.04 


4.99 


5.09 


2,57 


0.06 


42, 152 


1.53* 


T.R. School Adjustment 


4.0 


4.2 


4.) 


2, 57 


0.28 


42, 152 


1.53* 


T.R. Application to Learning 


4.1 


3.9 


4.1 


2, 56 


0.44 


42, 152 


1.72* 


T.R. Attitude Toward Reading 


4.i 


4.1 


4.1 


2, 53 


0.01 


42, 152 


2.01** 


T.R. Emotional Adjustment 


4.0 


4.1 


4.0 


2, 6 


0.21 


42, 152 


1.35 



The figures in parentheses refer to the pupils’ grade placement 
at the time of testing. 

b All mean scores on the Stanford reading subtests are grade equivalent scores. 

ERIC p<>05 ' 

** p<.01. 



Table 4 
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Mean scores, teacher ratings, and the results 
of hierarchal analyses of variance 
(Middle ability pupils) 





Treatment ms 


?ans 


Treatmer 


it effect 


Classroom effect 


Dependent variable 


i.t.a.-l 


T.O. 


i • t • a • "k 


df 


F 


df 


F 


SAT, Word Reading (1.5) a 


2 . 17 b 


1.68 


2.62 


2, 46 


25.27** 


41, 192 


3.14** 


SAT, Paragraph Meaning (1.5) 


1.67 


1.58 


2.06 


2, 47 


11.35** 


41, 192 


2.56** 


SAT, Vocabulary (1 .5) 


2.31 


2.16 


2.35 


2, 49 


0.84 


41, 192 


1.97** 


SAT, Spelling (1.5) 


2.05 


1.74 


2.43 


2,46 


12.82** 


41, 192 


3.25** 


SAT, Word Study Skills (1.5) 


2.94 


2.04 


3.59 


2,49 


18.83** 


41, 192 


2.02** 


SAT, Word Reading (1.9) 


2.05 


2.18 


2.32 


2,47 


1.96 


41, 192 


2.58** 


SAT, Paragraph Meaning (1.9) 


1.93 


2.09 


2.30 


2,47 


2.60 


41, 192 


2.67** 


SAT, Vocabulary (1 .9) 


2.66 


2.53 


2.64 


2,49 


0.40 


41, 192 


1.99** 


SAT, Word Study Skills (1.9) 


2.51 


2.65 


2.77 


2,46 


0.42 


41, 192 


2.95** 


SAT, Word Meaning (2.8) 


3.23 


3.41 


3.56 


2, 51 


0.94 


44, 174 


3.12** 


SAT, Paragraph Meaning (2.8) 


3.17 


3.37 


3.71 


2, 53 


2.62 


44, 174 


2.43** 


SAT, Spelling (2.8) 


2.98 


3.44 


3.57 


2, 57 


4.52* 


44, 174 


1.74** 


SAT, Word Study Skills (2.8) 


3.93 


4.41 


4.67 


2, 56 


1.68 


44, 174 


1.87** 


SAT, Language (2.8) 


3.18 


3.50 


3.62 


2,51 


1.34 


44, 174 


3.08** 


SAT, Word Meaning (3.9) 


4.38 


4.56 


4.65 


2,57 


0.47 


44, 157 


1.95** 


SAT, Paragraph Meaning (3.9) 


4.18 


4.50 


4.56 


2, 62 


1.61 


44, 157 


1.43 


SAT, Spelling (3.9) 


4.22 


4.43 


4.53 


2,63 


1.15 


44, 157 


1.32 


SAT, Word Study Skills (3.9) 


4.88 


5.03 


5.73 


2,60 


3.36* 


44, 157 


1.56* 


SAT, Language (3.9) 


4.40 


4.68 


4.74 


2,58 


0.75 


44, 157 


1.77** 


T.R. School Adjustment 


3.8 


3.9 


3.9 


2, 55 


0.19 


44, 157 


2.19** 


T.R. Application to Learning 


3.6 


3.8 


3.9 


2, 64 


0.90 


44, 157 


1.28 


T.R. Attitude Toward Reading 


3.7 


3.9 


4.0 


2, 60 


0.99 


44, 157 


1.54* 


T.R. Emotional Adjustment 


3.6 


3.9 


3.9 


2, 61 


1.87 


44, 157 


1.51* 



The figures in parentheses refer to the pupils' grade placement 
at the time of testing. 

All mean scores on the Stanford reading subtests are grade equivalent scores. 



ER]C P< ’ 05, 

** p<.01 . 



Table 5 
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Mean scores, teacher ratings, and the results 
of hierarchal analyses of variance 
(Low ability pupils) 





Treatment means 


Treatment effect 


Classroom effect 


Dependent variable 


i.t.a.-l 


T.O. 


i.t.a.-k 


df 


F 


df 


F 


SAT, Word Reading (1.5) a 


1.94 b 


1.46 


2.39 


2,43 


19.28** 


39, 185 


3.63** 


SAT, Paragraph Meaning (1 .5) 


1.59 


1.49 


1.85 


2,44 


6.07** 


39, 185 


3.14** 


SAT, Vocabulary (1 .5) 


1.92 


1.85 


2.11 


2, 48 


1.83 


39, 185 


1.72* 


SAT, Spelling (1.5) 


1.74 


1.53 


2.19 


2,41 


6.64** 


39, 185 


5.07** 


SAT, Word Study Skills (1.5) 


2.65 


1.75 


3.16 


2,42 


9.30** 


39, 185 


4.15** 


SAT, Word Reading (i.9) 


1.94 


1.89 


2.16 


2, 45 


2.57 


39, 185 


2.55** 


SAT, Paragraph Meaning (1 .9) 


1.79 


1.82 


1.99 


2,44 


1.17 


39, 185 


2.94** 


SAT, Vocabulary (1 .9) 


2.12 


2.19 


2.27 


2,47 


0.61 


39, 185 


1.98** 


SAT, Word Study Skills (1.9) 


2.24 


2.06 


2.52 


2,46 


2.63 


39, 185 


2.07** 


SAT, Word Meaning (2.8) 


3.05 


2.94 


3.18 


2,55 


0.69 


47, 164 


3.01** 


SAT, Paragraph Meaning (2 . 8) 


2.98 


2.88 


3.17 


2,57 


0.90 


47, 164 


2.56** 


SAT, Spelling (2 . 8) 


2.95 


3.03 


3.33 


2,56 


1.15 


47, 164 


2.86** 


SAT, Word Study Skills (2.8) 


3.73 


3.43 


3.81 


2,56 


0.51 


47, 164 


2.72** 


SAT, Language (2 . 8) 


3.03 


3.06 


3.22 


2, 57 


0.47 


47, 164 


2.49** 


SAT, Word Meaning (3 .9) 


3.86 


3.87 


4.02 


2,58 


0.21 


44, 137 


1.97** 


SAT, Paragraph Meaning (3 . 9) 


3.73 


3.73 


3.90 


2,54 


0.24 


44, 137 


2.71** 


SAT, Spelling (3.9) 


3.86 


3.97 


4.17 


2,53 


0.48 


44, 137 


2.98** 


SAT, Word Study Skills (3.9) 


4.54 


4.24 


4.86 


2, 60 


1.00 


44, 137 


1.81** 


SAT, Language (3.9) 


4.02 


3.91 


3.98 


2, 56 


0.06 


44, 137 


2.39** 


T.R. School Adjustment 


3.6 


3.7 


3.5 


2, 61 


0.33 


44, 137 


1.71* 


T.R. Application to Learning 


3.4 


3.6 


3.3 


2,74 


1.30 


44, 137 


1.00 


T.R. Attitude Toward Reading 


3.5 


3.7 


3.6 


2, 59 


0.25 


44, 137 


1.88** 


T.R. Emotional Adjustment 


3.4 


3.8 


3.6 


2,64 


1.81 


44, 137 


1.48 



The figures in parentheses refer to the pupils' grade placement 
at the time of testing. 



All mean scores on the Stanford reading subtests are grade equivalent scores . 




p . 05 . 



All mean scores on the Stanford reading sub tests are grade equivalent scores. 
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FIGURE 1 

MEAN SCORES OF CLASSES USING THE VARIOUS T.O. PROGRAMS 
BY THE i RcATMENT GROUPS IN GRADE TWO 
(HIGH ABILITY GROUP) 
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FIGURE 2 

MEAN SCORES OF CLASSES USING THE VARIOUS T.O. PROGRAMS 
BY THE TREATMENT GROUPS IN GRADE TWO 
(MIDDLE ABILITY GROUP) 
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FIGURE 3 

MEAN SCORES OF CLASSES USING THE VARIOUS T.O. PROGRAMS 
BY THE TREATMENT GROUPS IN GRADE TWO 
(LOW ABILITY GROUP) 
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Grade Placement • "Meaning enphaslzed" 

■ '"Mionics emphasized" x "Others" 



FIGURE 4 

MEAN SCORES OF CLASSES USING THE VARIOUS T.O. PROGRAMS 
BY THE TREATMENT GROUPS IN GRADE THREE 
(HIGH ABILITY GROUP) 
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FIGURE 5 

MEAN SCORES OF CLASSES USING THE VARIOUS T.O. PROGRAMS 
BY THE TREATMENT GROUPS IN GRADE THREE 
(MIDDLE ABILITY GROUP) 
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Grade 
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FIGURE 6 

MEAN SCORES OF CLASSES USING THE VARIOUS T.O. PROGRAMS 
BY THE TREATMENT GROUPS IN GRADE THREE 
(LOW ABILITY GROUP! 
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4. Beyond grade one, significant differences in Word Study Skills 
were due to the superiority of the middle and high ability i.t.a.-k 
pupils over either one or both of the corresponding i.t.a.-l and 
T.O. pupils. The i.t. a. -kindergarten group also outperformed the 
other two groups on almost all the subtests throughout the three 
years at all ability levels even though few statistical significances 
were obtained. 

5. Those i.t. a. pupils who used a reading series that emphasized 
the "phonics approach" tended to be superior to their counterparts 
who used readers that emphasized the "meaning approach." Most 
of the mean scores of the low ability level in the former group were 
at or above the grade placement for all subtests at the end of 
grades two and three. 

6. The analysis of third grade teacher ratings of pupils’ school adjustment, 
ability to apply self to learning, attitude toward reading, and general 
emotional adjustment revealed no significant differences among the 
I.t. a. and T.O. groups at all ability levels. However, the data 
Indicate that teachers' ratings on each of these characteristics vary 
according to the ability of the child. High ability children were 

rated as having better school adjustment, greater ability to apply 
themselves, better attitudes toward reading, and better emotional 
adjustment than middle and low ability children regardless of 
reading program. 

7. Classroom effects were significant for virtually all reading subtests 
and teacher ratings at all ability levels. 



Discussion 

The results of this study were consistent with those of earlier studies 
even when the classroom effects and ability levels were taken into 
consideration. When tested in i.*.a. during grade one, the i.t. a. pupils 
demonstrated significant superiority over the T.O. pupils in skills which 
require sound-letter association, such as Word Reading and Word Study Skills. 
When tested in T.O. at the end of grades two and three, few significant 
differences were found between i.t. a. pupils and T.O. pupils on spelling 
and other reading subtests. The concern of some educators that i.t. a. might 
have adverse effects on pupils' T.O. spelling and reading has not been 
substantiated by researci . 

The possibility that some kind of automatic transition from i.t. a. to 
T.O. might occur is suggested by the fact that no significant differences 
were found between the i.t. a. groups and T.O. group at the end of grade 
O le before most i.t. a. pupils had made the formal transition. This and other 
ERjCestion* about how children make the transition from i.t. a. to T.O. should 
“ aasa S a u more fuJly investigated. 
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This study suggests that the type of program used In the post- 
transition period is a key factor to success in T.O. reading, particularly 
for the low ability pupils. The data reflect a trend favoring a phonics- 
oriented program. This kind of program probably helps to capitalize on 
the early advantages achieved through the use of l.t.a. Further study on 
this topic should be conducted. 

This study shows that starting l.t.a. in kindergarten is not only 
possible, but seems to have long-term beneficial effects on pupils' 
achievement. The group of pupils who started l.t.a. instruction in 
kindergarten maintained their advantage through the end of grade three. 

Since no T.O. classes beginning reading instruction in kindergarten were 
available for this study, it is not possible to compare the merits of starting 
T.O. or l.t.a. in kindergarten. Further study is needed to provide the 
answer. 

The fact that there were no significant differences between the T.O. 
and l.t.a. groups on the teachers' ratings might suggest the following: 

(a) The Instruments were too crude, (b) Teachers' interpretations of the 
rating scales were different, (c) The difference between the T.O. and 
l.t.a. groups might occur in grades one and two but disappear in grade three, 
(d) The limited categories in the five-point ratings might make it impossible 
to discriminate among the treatment groups within each ability level. 

Greater emphasis should be given to the development of scales which will 
measure affective variables. 

The use of l.t.a. has been questioned by some educators because of 
the lack of statistical differences in reading achievement between l.t.a. and 
T.O. pupils beyond grade one in most studies. If it is assumed that we 
want children to have the best possible success at every level of school 
learning, l.t.a. certainly has its merits in enhancing the beginning reader's 
word attacking skills. Furthermore, since l.t.a. spelling is regular, the 
child is likely to be able to read the l.t.a. books with relatively little help 
from the teacher once he learns to decode. This means that the l.t.a. books 
need not be as limited in vocabulary, scope, and content as the T.O. books 
for the beginning readers. Thus, the child could be helped to develop an 
enthusiasm for reading and for learning with a wide range of interesting and 
educationally valuable materials . Attention, however, should be given to 
utilizing the l.t.a. pupils' superior word study skills to develop vocabulary 
and comprehension. 
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HIERARCHAL ANALYSIS OF VARIANCE WITH UNEQUAL SAMPLE SIZES 

Maurice M. Tatsuoka 

As described in the main body of this report, a two-factor hierarchal 
design was applied to each of nine samples of pupils, defined in terms of 
two descriptor variables: Grade Level (first, second, and third) and Ability 
Level (high, average, and low). 

The two factors (or independent variables) were: [a] Type of Initial 
Reading Program (i.t.a-K, i.t. a. -1, and T.O.) and [ b] Teacher. The 
design is said to be hierarchal or "nested," because different levels of 
Factor B (i.e. different teachers) occur within the three levels of Factor A. 

A schematic representation of the design is, therefore, as follows: 

A i (l . t . a . -K) A 2 (l.t.a.-l) A 3 (T.O.) 

Bj B 2 B 3 . . . Bjg Bj 7 B 18 ... B 24 B 25 B 26 ... B 39 



XXX X XX X XX X 

XXX X XX x X x 




This means that there were 39 teachers in all ( Bj , B 2 , . ..,B 3 g), 16 of 
whom taught pupils with the Aj initial reading program, 8 of whom taught A 2 
pupils, and 15 taught A 3 pupils. (The actual numbers are those for the grade one 
high ability sample. The oth<*r eight samples will have different ranges of the 



subscript for B under each A level.) The x's represent the observations, 
or dependent-variable values (scores) for pupils taught by each teacher. 



The idea of hierarchy or nestedness may perhaps be further clarified 
by comparing the above design (the one actually used in this study) with a 
design in which nesting does not occur. The latter would apply if it had 
been the case that the same teachers (say 13 in number) taught pupils of 
all three initial reading program types (i.e. levels of Factor A), thus: 



A 



1 



A 



2 



A 3 



B, B, 



B 



13 



B i B, 



B 



13 



B, B 



13 



XX X 

XX x 

• • • 

• • • 

• X 



XX X 

. X 

• • • 

• • 1 

X • » 



XX X 

X X . 

I I I 

. . X 



X X .XX. 

X X 

Note that, although we again have 39 groups of pupils, we now do not 
have 39 teachers but only 13; the same 13 teachers occur under all three levels 
of Factor A. In this case, Factor B is not nested within Factor A, but is said 
to be crossed with Factor A. 



Coming back to the hlerarchal design that was actually used in this 
study, recall that there were several dependent variables for each grade level. 
More specifically. Tables 3-5^ show that there were ten dependent variables 



* See pp. 9-11 in the Technical Report. 
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for grade one, five for grade two, and nine for grade three. Since there 
were three ability levels in each grade, this means that 30 + 15 + 27 = 72 
separate two-factor hierarchal-design analyses were carried out in all. 

The outline and formulas presented below apply to each one of these 72 
separate analyses. 

To simplify the notation somewhat, we now switch from the consecutive 
numbering (Bj, B 2 , . . . , Bgg) of levels of Factor B (teachers) to a system 
which enumerates the teachers separately for each level of Factor A. That 
is, we henceforth designate the B levels by a double-subscript notation, 
thus, for example: 



1(1)' B 2(l) ' 


•**' B 1 6(1) 


for teachers nested in Aj,* 


U2)' B 2 (2) ' 


•••' B 8 (2) 


for teachers nested in A 2 ; 


1(3)' B 2 (3) ' 


•••' B 1 5(3) 


for teachers nested in A^. 



Thus, the teacher previously denoted by Bi 2 Is now represented 
by B 1 2 (1)* teacher B 2 q is now B^^)* ®32 Be omes Bg^j; and so on. In 
general, Bj(j) denotes the J-th teacher nested in Aj, the i-th level 
of Factor A (where i = 1, 2, 3). (This may seem like a complication 
rather than simplification of notation, but it actually simplifies the 
notation in the subsequent formulas 1) More generally, we denote by 
1 the number of teachers nested in Aj (i ® ) , 2, 3). 



O 
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With the foregoing notatlonal conventions, we are now ready to present 
the formulas for the various sums-of-squares (SS's), their degrees of 
freedom (df's), and the resulting mean-squares (MS's) that enter into the 
significance tests. We denote by X, the dependent variable used in any 
one of the 72 analyses carried out. Triple subscripts are needed to specify 
individual scores on X, as follows: 

Xjjk = score of k-th pupil in the class taught by J-th teacher nested 
in Af. 

The subscripts here have the following ranges: 



1 = 1, 2, 3 (there being three programs, Aj, Ag, Ag), 

J = 1, 2, ... , ( = the number of teachers nested in Aj), 

k * l » 2 n iJ ( = the number of pupils in teacher 's class). 

The several kinds of means are defined and denoted as follows: 

(the mean for teacher B^'s class), 



M. . 



' n u 


2 


Xijk 


^ k=l 


/ ft 


n u 


2 


2 


V j=i 


k=l 




1J 



(the mean for program Aj), 



auk) A 

0, 

njj (the number of pupils in Ai ) 



2 

J=i 



3 
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where Nj = 



27 



/ 3 


0i 


n u 




X -( 2 


2 


2 




\i = l 


J = l 


k = 
3 


l 


where 


N = 

i 


2 Nj 

= 1 


[ 


Finally, the SS’s and their df' 


s are 




3 


0i 


n U 


SS within B = 


2 
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2 




i = l 


J=i 


k=l 
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df = 
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S 1 
t,J 

0i 


("u 


SS B(A) 
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i=i 
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J=i 


"if 




df 
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= 2 
i=i 
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CO 

•> 

II 


2 

i=l 


N i 


(*•■ 



X Uk, 



N (the grand mean). 



(total size of any grade- 
ability sample). 



Mjk 



- X 



ij. 



• A- f - (fii + fit * 0 3 )' 

(*U. * *i.. ) 2 - 



_ \ 2 



df = 2. 



As usual, each SS divided by its df yields the corresponding MS. Two 

of these, MSq^ and MS^, become the numerators of F ratios for testing 

the significances of the two main effects, B and A, respectively. (The B or 
2 

teacher effect is only of incidental interest; the A effect — that of the 
different initial reading programs — is of primary concern in this study.) 

The numerators for the relevant *F ratios are readily co iputed as Indicated 
above. The denominator (or "error MS") appropriate for each F ratio is much 
2 

In the body of the technical report, a more general term "classroom effect" is 
^ used Instead of "teacher effect." It was felt that not only the teacher, but 

other factors such as instruction, peer group, etc. were unique for each 

k i rnwinfrtn classroom. 
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more difficult to obtain — especially when ft j (the number of B levels nested 
in Aj) varies from one A level to another, as it does in this study, as well as 
n^j varying from one class to another. The general principle is as follows: 

Each error MS must be such that, under the corresponding nu ll 
hypothesis [no teacher effect (i.e.,B(A) effect) and no 
program effect (i.e. A effect) respectively J the numerator MS will 
have an expected value equal to the expected value of that error MS. 



According to Kempthorne (1952, pp. 108-109), with one correction by the 
present author, the relevant expected values are as follows (where we abbreviate 
"within B" as "w - B"): 



( ms »-b) 



E ( MS 8(A>) 



= <J , 



2 2 
= <T 1 + P <7 b , 



( ms a ) 



* <T + Q <r b + R <r a 



where 



P = 



N - 2 



Q “ 2 



1=1 

3 / 2 

l ni) 




2 

i=i 



Mi 



3 2 

2 2 2 

— 1 =1 1=1 

N 



R = 1 
2 



2 V 

N — i-1 



N 




and 
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2 

<7 is the variance due to sampling error (i.e., individual 
differences among pupils) 

<7 2 is the variance due to program effects, 

a 

2 

<7 b is the variance due to teacher effects. 

It is thus seen that the appropriate error MS for MSg^ (i.e., the 
denominator of the F ratio for testing the teacher effect) is simply MS w _g 
itself. For 

E (MSg^) = <7^ + P <7^ reduces to <7^, which is E (MS w _g), 

, 2 

when (7 =0. 

The appropriate error MS for MS^ [i.e. , the denominator of the 
F ratio for testing the program effect (which is of prime interest)] , 
on the other hand, must be constructed from a linear combination 
L = Ci (MS w _g) + C 2 (MS b(a) ) 

in such a way that 

E (L) = <7 2 ♦ Q <7 b 2 , 

which is what E (MS^) reduces to when <7 a ^ = 0 (i.e., under the null 
hypothesis of "no program effecV’). 




It may be vetifled that the above condition for L is satisfied if (and only if) 
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we take the following values for and C 2 : 

1 P 1 p 

where P and Q are as defined earlier. Thus, the appropriate error MS 
for MS^ is given by: 

MS e(A) - (^r 5 ) MS «- b + (-§-) ms b(a> • 

The only remaining question is that of the df for this error MS. 

There is apparently no universal consensus among statisticians on this 
question, but one widely accepted solution is that given by Mood (1950, 
pp. 334-348). Following this approach, the df for MS e ^j would be 
given by 

[ c i ms w _ b + c 2 ms b(a) ] 2 
dfe < A > = Cj 2 (ms w _ b ) 2 + c 2 2 (ms b(A )) 2 

N- ( /Sj + 0 2 + /3 3 ) @1 + & 2 + ^ 3-3 

where and C 2 are as specified above. 

This completes our description of the roir >e .sed in each of the 72 two- 
factor hierarchal design analyses used in this s ' /. The actual computations 
were carried out at the University of Illinois Cc ter Center by Dr. Doyle Bishop, 
using a program which he wrote especially for tr :e alyses. 
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MEAN SCORE PROFILES 
FOR GRADES ONE, TWO, AND THREE 
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FIGURE 7 FIGURE 8 FIGURE 9 

MEAN SCORES OF HIGH ABILITY PUPILS MEAN SCORES OF MIDDLE ABILITY PUPILS MEAN SCORES OF LOW ABILITY PUPILS 

ON THE STANFORD ACHIEVEMENT TEST ON THE STANFORD ACHIEVEMENT TEST ON THE STANFORD ACHIEVEMENT TEST 

AT GRADE PLACEMENT 1 .5 AT GRADE PLACEMENT 1 .5 AT GRADE PLACEMENT 1 .5 
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FIGURE 10 FIGURE 11 FIGURE 12 

MEAN SCORES OF HIGH ABILITY PUPILS MEAN SCORES OF MIDDLE ABILITY PUPILS MEAN SCORES OF LOW ABILITY PUPILS 
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FIGURE 16 FIGURE 17 FIGURE 18 

MEAN SCORES OF HIGH ABILITY PUPILS MEAN SCORES OF MIDDLE ABILITY PUPILS MEAN SCORES OF LOW ABILITY PUPILS 

ON THE STANFORD ACHIEVEMENT TEST ON THE STANFORD ACHIEVEMENT TEST ON THE STANFORD ACHIEVEMENT TEST 

AT GRADE PLACEMENT 3 .9 AT GRADE PLACEMENT 3.9 AT GRADE PLACEMENT 3.9 
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